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OPTIMIZATION  WITH  VARIABLE-FIDELITY  MODELS  APPLIED  TO  WING  DESIGN 

NATALIA  M.  ALEXANDROV* * * §,  ROBERT  MICHAEL  LEWISt,  CLYDE  R.  GUMBERT*,  LARRY  L.  GREEN§,  AND 

PERRY  A.  NEWMAN^ 

Abstract.  This  work  discusses  an  approach,  the  Approximation  Management  Framework  (AMF),  for 
solving  optimization  problems  that  involve  computationally  expensive  simulations.  AMF  aims  to  maximize 
the  use  of  lower-fidelity,  cheaper  models  in  iterative  procedures  with  occasional,  but  systematic,  recourse  to 
higher-fidelity,  more  expensive  models  for  monitoring  the  progress  of  the  algorithm.  The  method  is  globally 
convergent  to  a  solution  of  the  original,  high-fidelity  problem.  Three  versions  of  AMF,  based  on  three 
nonlinear  programming  algorithms,  are  demonstrated  on  a  3D  aerodynamic  wing  optimization  problem  and 
a  2D  airfoil  optimization  problem.  In  both  cases  Euler  analysis  solved  on  meshes  of  various  refinement 
provides  a  suite  of  variable-fidelity  models.  Preliminary  results  indicate  threefold  savings  in  terms  of  high- 
fidelity  analyses  in  case  of  the  3D  problem  and  twofold  savings  for  the  2D  problem. 

Key  words,  approximation  concepts,  approximation  management,  model  management,  surrogate  opti¬ 
mization,  aerodynamic  optimization,  nonlinear  programming,  wing  design 

Subject  classification.  Applied  and  Numerical  Mathematics 

1.  Introduction.  Many  physical  phenomena  in  engineering  design  can  be  described  by  computational 
models  of  high  physical  fidelity  or  numerical  accuracy.  However,  the  use  of  high-fidelity  models,  such  as 
the  Navier-Stokes  equations  or  those  based  on  fine  computational  meshes,  in  iterative  procedures  can  be 
prohibitively  expensive.  On  the  other  hand,  the  use  of  corresponding  lower-fidelity  models  alone  does  not 
guarantee  improvement  for  higher-fidelity  design.  This  paper  discusses  an  approach  that  aims  to  facilitate 
design  optimization  and  integration  of  disciplines  in  a  multidisciplinary  environment  by  alleviating  the  ex¬ 
pense  of  relying  exclusively  on  high-fidelity  models,  while  taking  advantage  of  well-established  engineering 
approximation  concepts. 

Computational  models  of  varying  fidelity  have  been  used  in  engineering  design  for  a  long  time  [32,  33,  34]. 
A  survey  on  the  use  of  approximations  in  structural  optimization  can  be  found  in  Barthelemy  and  Haftka  [9] . 
Recent  overviews  of  algorithms  for  aerodynamic  analysis  and  optimization  can  be  found,  e.g.,  in  Jameson  [23] 
and  Newman  et  al.  [28].  Procedures  for  using  variable-fidelity  models,  however,  have  been  largely  based 
on  heuristics,  and  convergence  to  a  solution  of  the  highest-fidelity  optimal  design  problem  has  not  been 
guaranteed,  in  general.  Until  recently,  with  a  few  exceptions  [8,  27,  29],  the  analysis  had  focused  on  the 
question  of  convergence  to  a  solution  of  the  surrogate  problem  [14,  22] .  Due  to  improvements  in  the  numerical 

*  Multidisciplinary  Optimization  Branch,  Mail  Stop  159,  NASA  Langley  Research  Center,  Hampton,  VA,  23681-2199, 
n .  alexandrovQlarc . nasa . gov. 

+ICASE,  Mail  Stop  132C,  NASA  Langley  Research  Center,  Hampton,  Virginia  23681-2199,  buckaroo0icase.edu.  This 
research  was  supported  by  the  National  Aeronautics  and  Space  Administration  under  NASA  Contract  No.  NAS  1-97046  while 
the  author  was  in  residence  at  the  Institute  for  Computer  Applications  in  Science  and  Engineering  (ICASE),  NASA  Langley 
Research  Center,  Hampton,  VA  23681-2199. 

t Multidisciplinary  Optimization  Branch,  Mail  Stop  159,  NASA  Langley  Research  Center,  Hampton,  VA,  23681-2199, 
c.r.gumbert 01 arc .nasa.gov. 

§  Multidisciplinary  Optimization  Branch,  Mail  Stop  159,  NASA  Langley  Research  Center,  Hampton,  VA,  23681-2199, 
1.1.  gr  een01ar  c .  nas  a .  gov. 

^ Multidisciplinary  Optimization  Branch,  Mail  Stop  159,  NASA  Langley  Research  Center,  Hampton,  VA,  23681-2199, 
p .  a .  newmanQlar  c  .nasa.  gov. 


1 


modeling  techniques  and  the  increased  availability  of  high-fidelity  analyses,  optimization  with  variable-fidelity 
approximations  has  become  a  subject  of  much  interest  in  the  past  few  years  [15,  21,  30]. 

A  number  of  methods  for  managing  models  and  approximations  of  varying  fidelity  have  been  recently 
introduced  and  analyzed.  These  include  methods  that  use  sensitivities  [3,  25,  1,  5]  and  methods  that  do 
not  [13].  This  paper  begins  a  computational  investigation  of  the  practical  effectiveness  of  the  methods 
in  [3,  25,  1,  5]  on  problems  of  aerodynamic  design  optimization. 

For  the  purposes  of  the  present  work,  the  optimal  design  problem  is  represented  by  the  following  nonlinear 
programming  problem  (NLP): 

minimize  f(x) 

(1.1)  subject  to  g(x)  <  0 

l  <  x  <u , 

where  x  are  the  design  variables,  the  objective  /  and  the  vector-valued  constraints  g  are  smooth  (i.e., 
continuously  differentiable)  nonlinear  functions,  and  l  <x  <u  denotes  bound  constraints  on  design  variables. 
This  work  concerns  a  general  approach  for  controlling  the  use  of  variable-fidelity  models — the  first-order 
trust-region  Approximation  Management  Framework  (AMF) — in  solving  problem  (1.1). 


Fig.  1.1.  Conventional  optimization  vs.  AMF 

The  conceptual  distinction  between  AMF  and  conventional  optimization  is  depicted  in  Figure  1.1.  On 
the  left,  in  conventional  optimization,  the  optimizer  and  the  analysis  software  exchange  information  as  fol¬ 
lows.  The  analysis  supplies  the  optimizer  with  objective  and  constraint  function  and  derivative  information, 
/,  V/,  </,  Vp,  while  the  optimizer  produces  new  values  of  the  design  variables  x  for  re-analysis.  The  optimizer 
uses  the  function  and  derivative  information  to  build  local  approximations — usually  first  or  second-order 
Taylor  series — internally.  If  evaluating  the  problem  functions  and  derivatives  involves  a  simulation  of  high 
accuracy  but  high  computational  cost  (e.g.,  the  Navier-Stokes  equations),  repeated  consultations  with  anal¬ 
ysis  required  by  the  optimizer  are  expensive. 

Now  suppose  one  also  has  a  suite  of  less  accurate  but  also  less  expensive  approximate  models  or  surro¬ 
gates1  of  the  same  phenomenon.  A  lower-fidelity  model  of  the  objective  is  denoted  by  {af(x)}  and  lower- 

1Some  authors  make  distinctions  in  the  use  of  the  terms  “models”,  “surrogates”,  and  “approximations.”  For  simplicity,  the 
terms  are  used  interchangeably  here. 
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fidelity  model  of  the  constraints  by  {a5(x)}.  The  associated  sensitivities  with  respect  to  the  design  variables 
are  (Va^(x)}  and  {Vafl(x)}. 

The  right-hand  side  of  Figure  1.1  depicts  information  exchange  between  the  optimizer  and  the  anal¬ 
yses  in  a  conceptual  AMF  scheme.  Here  the  optimizer  receives  the  function  and  sensitivity  information 
af(x),  Vaf(x),a9(x),  Wa9(x)  from  the  lower-fidelity  model  to  build  internal  local  models  (Taylor  series). 
Expensive,  high-fidelity  computations  proceed  outside  the  optimization  loop  and  serve  to  re-calibrate  the 
lower-fidelity  model  occasionally,  based  on  a  set  of  systematic  criteria.  The  salient  features  of  AMF  are  as 
follows. 

•  Although  a  lower-fidelity  model  may  not  capture  a  particular  feature  of  the  physical  phenomenon 
to  the  same  degree  of  accuracy  (or  at  all)  as  its  higher-fidelity  counterpart,  a  lower-fidelity  model 
may  still  have  satisfactory  predictive  properties  for  the  purposes  of  finding  a  good  direction  of 
improvement  for  the  higher-fidelity  model. 

•  AMF  replaces  the  local,  Taylor  series  approximations  of  the  conventional  optimization  by  general 
nonlinear  models  required  to  satisfy  a  set  of  first-order  consistency  conditions  defined  later  in  the 
paper.  In  principle,  AMF  is  capable  of  handling  arbitrary  models,  provided  the  easily  imposed 
consistency  conditions  are  satisfied. 

In  particular,  AMF  is  not  limited  to  the  use  of  algebraic,  Taylor  series,  or  response  surface  approxi¬ 
mations.  Analyses  of  variable  mesh  resolution  or  of  variable  physical  fidelity  (such  as  Navier-Stokes 
and  Euler  codes)  can  be  used  as  variable-fidelity  function  evaluators  in  AMF. 

•  In  AMF-based  algorithms,  the  bulk  of  the  computational  expense  involves  calculations  based  on 
lower-fidelity  models  in  iterations  of  optimization  or  search  procedures. 

•  AMF  is  based  on  the  trust-region  methodology  [18,  26],  which  can  be  described  as  an  adaptive 
move  limit  strategy  for  improving  the  global  behavior  of  optimization  algorithms  based  on  local 
models.  The  trust-region  methodology  ensures  the  convergence  of  the  AMF  scheme  to  a  solution  of 
the  higher-fidelity  problem  by  providing  a  measure  of  the  surrogate’s  predictive  behavior,  a  criterion 
for  updating  the  surrogate,  and  a  systematic  response  to  situations  in  which  an  optimization  phase 
performed  using  a  surrogate  gives  either  an  incorrect  or  a  poor  prediction  of  the  higher-fidelity 
model’s  actual  behavior. 

The  proposed  AMF  methods  have  strong  theoretical  properties  and  have  been  tested  on  small,  closed-form 
problems.  The  framework’s  generality  means,  however,  that  it  admits  not  only  a  wide  range  of  models,  but 
also  an  extensive  set  of  rules  for  governing  parts  of  AMF.  The  rules  do  not  influence  the  fact  of  convergence, 
but  they  strongly  influence  the  algorithm’s  efficiency.  Moreover,  the  performance  of  the  algorithm  will  also 
be  problem-dependent.  Hence,  much  computational  experience  is  needed  both  to  validate  the  concept  and  to 
arrive  at  an  advantageous  set  of  rules  for  the  use  of  approximations  within  a  specific  instance  of  AMF.  This 
study  intends  to  demonstrate  the  concept  of  AMF  on  two  aerodynamic  optimization  problems.  In  addition, 
the  study  begins  the  accumulation  of  the  necessary  computational  experience  that  should  result  in  fur¬ 
ther  practical  implementations  of  AMF,  both  for  single-discipline  and  multidisciplinary  design  optimization 
(MDO). 

The  paper  is  organized  as  follows.  The  next  section  briefly  describes  the  three  AMF  under  study.  The 
computational  demonstration  is  then  described.  The  paper  concludes  with  lessons  learned  to  date  and  some 
mention  of  ongoing  work. 

2.  AMF  Under  Study.  There  are,  in  principle,  as  many  possible  AMF  as  there  are  optimization 
algorithms,  because  AMF  may  be  defined  as  a  mechanism  for  a  systematic  alternation  between  the  available 
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models  within  an  optimization  procedure.  A  detailed  discussion  of  the  algorithms  and  analysis  of  the  entire 
class  of  first-order  AMF  for  constrained  optimization  can  be  found  in  Alexandrov  and  Lewis  [7] . 

In  this  section,  three  AMF  are  described,  and  the  reasons  for  their  selection  are  discussed.  The  first 
AMF  is  based  on  an  augmented  Lagrangian  approach,  the  second  on  a  multi-level  optimization  algorithm, 
and  the  third  on  an  SQP  approach.  In  the  remainder  of  the  paper,  the  subscripts  “c”  and  denote  the 
current  and  the  new  iterate,  respectively. 

2.1.  Augmented  Lagrangian-based  AMF.  The  augmented  Lagrangian  method  for  constrained  op¬ 
timization  allows  for  an  immediate  extension  of  the  unconstrained  AMF  to  constrained  problems.  The 
underlying  algorithm  is  the  augmented  Lagrangian  approach  as  implemented  in  Conn,  Gould,  and  Toint  [17]. 

In  this  method,  the  explicit  nonlinear  inequality  constraints  of  problem  (1.1)  are  converted  to  equalities 
by  introducing  nonnegative  artificial  (slack)  variables  z  to  define  the  equality  constraints 

h(x,z)  =  g(x)  +  z, 

which  gives  rise  to  the  following  equivalent  formulation: 

minimize  /  (x) 

x,z 

^2  subject  to  h{x)  z)  —  0 

l  <  x  <  u 
z>  0. 

The  associated  augmented  Lagrangian  is 

L(x,  z,  A;  /x)  =  f(x)  +  A Th(x,  z)  +  L  ||  h{ x,  z)  \f2 , 

where  A  is  the  vector  of  Lagrange  multipliers,  and  /z  >  0  is  the  penalty  parameter.  For  appropriate  values 
of  /z  and  A,  minimization  of  L  solves  problem  (2.1).  However,  since  the  appropriate  values  of  /z  and  A 
are  not  known  a  priori ,  an  iterative  approach  is  devised  that  solves  an  augmented  Lagrangian  subproblem 
while  updating  /z  and  A.  The  conventional  augmented  Lagrangian  approach  is  described  in  the  following 
pseudo-code: 

Initialize  ( xc,zc ),  Ac,  \ic 
Do  until  convergence: 

With  (xc,zc)  as  the  initial  point  and  fixed  Ac,/zc, 
solve  the  following  subproblem  for  (x+,  z+): 
minimize  L(x,  z;  Ac,/zc) 

x,z 

subject  to  l  <x  <u 
z  >  0 

Set  (xc,zc)  =  (x+,z+) 

Update  Ac  and  \lc 
End  do 

The  corresponding  augmented  Lagrangian-based  AMF  uses  a  subproblem  that  minimizes  not  L  but  its  model 
a^,  which  yields  the  following  AMF: 

Initialize  (xc,zc),  Ac,  \ic 
Do  until  convergence: 

Compute  the  high-fidelity  L  and  VL  at  (xc,  zc) 
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Select  an  approximation  oJp  to  L,  with 
CL^(^XCi  %c-i  Ac  5  Me)  =  L{xc^  ZC)  Ac|  Me)  and 
Voc  (®c,  *c,  Ac;  Me)  =  VL(a;Cj  2c:>  ^cj  Me) 
Do  until  convergence: 

Solve  approximately  for  (a?+,z+): 
minimize  (x,  z;  Ac,  Me) 


subject  to 


l  <  x  <  u 


End  do 
Compute  R  = 


||  xc  —  x  <  Ac 
||  zc  Z  || QO  <  Ac 

L(xc,  zCi  Ac;  Me)  -^(^+7  z+j  Ac,  Me) 


L(xc,  zC)  Ac;  Me)  ~  Ac;  Me) 

Update  Ac  and  (xC)  zc),  based  on  the  value  of  R 

Update  Ac  and  fic 
End  do 

Minimizing  is  itself  an  iterative  procedure  that  now  uses  approximations  (e.g.,  Taylor  series)  to  the 
lower-fidelity  model  aJp .  See  reference  [7]  for  further  details. 

The  conditions  on  the  model  are  known  as  the  first-order  consistency  conditions.  They  are  imposed 
by  a  correction  technique  introduced  by  Chang  et  al.  [16].  This  technique  corrects  a  low-fidelity  version  (f)\Q 
of  a  function  so  that  it  agrees  to  first-order  with  a  given  high-fidelity  version  0hi-  This  is  done  by  defining 
the  scale  factor  p 


/3(x)  = 


<t>lo{x)  ' 


Given  the  current  design  variables  xc ,  one  builds  a  first-order  model  pc  of  P  about  xc: 

Pc(x)  -  P{xc)  +  Vp(xc)T{x  -  xc ). 

The  local  model  of  P  is  then  used  to  scale  <f>\0  to  obtain  a  better  approximation  a(x)  of  <£hi* 

<Mz)  =  Pix)(j)\o{x)  «  a(x)  =  Pc(x)<f)\0{x). 


The  corrected  approximation  a(x)  has  the  properties  that  a(xc)  =  (fthifac)  and  Va(xc)  =  V<j) hi(xc). 

The  augmented  Lagrangian-based  AMF  is  relatively  easy  to  implement  and  can  be  proven  to  work 
reliably  under  reasonable  assumptions.  The  underlying  framework  is  well  understood  and  is  a  basis  for  a 
number  of  popular  codes.  The  expected  difficulties  are  also  those  of  the  underlying  optimization  algorithm — 
augmented  Lagrangian  methods  can  converge  slowly,  depending  on  how  A  is  estimated,  and  they  are  also 
subject  to  ill-conditioning  as  fi  approaches  0. 

2.2.  MAESTRO-based  AMF.  Another  AMF  is  based  on  a  class  of  multilevel  algorithms  for  large- 
scale  constrained  trust-region  optimization  (MAESTRO)  [2,  4,  6].  This  AMF  is  of  interest  due  to  MAE- 
STRO’s  convergence  properties  and  a  natural  structure  for  MDO  problems  with  arbitrary  couplings.  The 
reader  is  referred  to  Alexandrov  [5]  for  details  of  the  MAESTRO-based  AMF.  A  brief  description  follows. 

The  present  version  of  the  underlying  MAESTRO  approach  deals  with  problem  (1.1)  by  converting  the 
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explicit  inequalities  into  equalities  via  squared  slacks: 

minimize  f(x) 

(2.2)  *■*  _ 

subject  to  h(xy  z)  =  g(x)  4-  zz  =  0. 

Because  the  current  demonstration  problems  have  one  discipline  and  a  small  number  of  variables,  only  the 
bilevel  MAESTRO  procedure  will  be  described  here. 

If  (xc,  zc)  is  the  current  iterate,  a  model  of  the  constraints  is  first  selected  that  satisfies  the  following 
consistency  conditions  for  the  constraints  at  that  point: 

(2.3)  a^(xc,zc)  =  h(xc,zc) 

Vac  (xejzc)  —  ^h(xcy  Zc)- 

A  substep  si  =  (sf,sf)  is  computed  that  approximately  minimizes  that  model  within  a  trust  region.  The 
process  of  computing  the  substep  is  itself  an  iterative  procedure.  Next,  a  model  a[  of  the  objective  function 
or  the  Lagrangian  is  selected  that  satisfies  the  consistency  conditions  at  the  just  computed  point: 

(2.4)  afc(xc  4-  **)  =  f(xc  4-  «f) 

Va£(ac  4-  sf)  =  Vf{xc  +  sf). 

The  substep  s2  =  (sf ,  sf )  is  computed  in  another  loop  to  approximately  minimize  the  model  in  another  trust 
region.  The  total  trial  step  sc  is  the  sum  of  the  two  substeps.  The  step  is  evaluated  using  a  merit  function 
(the  augmented  Lagrangian  or  the  £ 2  penalty  function). 

The  consistency  conditions  can  be  relaxed,  but  that  line  of  reasoning  will  not  be  pursued  here,  because, 
given  any  two  models,  the  conditions  are  easily  enforced  by  using  the  correction  techniques  due  to  Chang, 
et  al.  [16].  The  consistency  conditions  are  not  enforced  within  each  optimization  sweep. 

This  algorithm  for  computing  the  trial  step  is  a  special  case  of  the  MAESTRO  class  with  the  distinction 
that  the  Gauss-Newton  model  of  the  constraints  and  the  quadratic  model  of  the  objective  or  the  Lagrangian 
have  been  replaced  by  general,  first-order  models  that  satisfy  the  consistency  conditions  (2.3)  and  (2.4). 

Since  the  underlying  algorithm  belongs  to  the  MAESTRO  class,  this  AMF  will  converge  to  a  critical 
point  of  the  high-fidelity  problem  under  the  assumptions  that  lead  to  convergence  of  the  underlying  class. 
This  means  finding  the  substeps  si  and  s2  that  will  satisfy  the  sufficient  decrease  conditions  necessary  for 
establishing  convergence. 

Implementing  a  MAESTRO-based  AMF  is  more  laborious  than  the  augmented  Lagrangian-based  AMF. 
The  benefits  are  greater  efficiency  and  the  expected  incorporation  of  MDO  problems  in  the  near  future. 

2.3.  SQP-based  AMF.  Sequential  Quadratic  Programming  (SQP)  methods  are  a  popular  class  of 
methods  for  solving  nonlinear  programming  problems.  An  overview  of  these  algorithms  can  be  found  in  Gill, 
Murray,  and  Wright  [20].  There  are  many  variants  of  SQP.  If  Bc  denotes  an  approximation  to  the  Hessian 
of  the  objective  function  /,  one  conventional  approach  to  solving  problem  (1.1)  is  the  following: 

Initialize  xc 
Do  until  convergence: 

Solve  the  following  subproblem  for  sc  —  x  —  xc‘ 
minimize  V/(xc  4-  s)T s  4-  \sTBcs 

subject  to  g{xc)  +  Vg(xc)Ts  <  0 
l  <x  <u 
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Update  xc 

End  do 

Typically,  the  objective  function  in  the  SQP  subproblem  is  a  quadratic  approximation  to  the  problem 
Lagrangian.  Globalization  strategies,  such  as  line  search  or  trust-region  approaches,  are  then  used  to  insure 
the  robustness  of  the  algorithm. 

An  SQP-based  AMF  studied  here  is  based  on  the  algorithm  just  outlined.  It  has  been  selected  for  the 
study  as  an  alternative  to  MAESTRO  in  the  case  of  single-discipline  optimization,  where  the  objective  and 
constraint  values  are  given  by  a  single  analysis  execution  (i.e.,  when  there  is  no  natural  multilevel  structure 
in  the  problem). 

Let  P(x;  n )  be  a  merit  function  for  the  high-fidelity  problem.  In  the  work  described  here,  P  is  the  lx 
penalty  function,  but  other  choices  are  possible.  The  SQP-based  AMF  is: 

Initialize  xc,  fic 

Do  until  convergence: 

Select  approximations  a[  and  a§,  with 
a{.(xc)  =  f(xcy,Vafc{xc)  =  'Vf(xc)  and 
a9c(xc)  =  g(xc);  Vag( xc)  =  Vg(xc). 

Solve  approximately  for  s  =  x  —  xc: 

minimize  a£  ( xc  +  s) 

s 

subject  to  a9(xc)  4-  Va9c(xc)Ts  <  0 
l  <  x  <u 
II  ^  IL  <  Ac 

End  do 

Compute  P(xc  +  sc) 

Update  Ac  and  xc ,  \ic  based  on  the  value  of  P 

End  do 

Details  and  analysis  of  the  implementation  can  be  found  in  [7].  Briefly,  the  approach  has  a  number  of  benefits. 
The  SQP-based  AMF  is  relatively  easy  to  implement  and  converges  very  rapidly  once  it  is  near  a  solution. 
It  handles  the  inequality  constraints  directly  and  enjoys  the  efficiency  of  SQP  methods.  By  choosing  Ac 
sufficiently  large,  it  can  be  arranged  for  the  first  iteration  to  go  to  a  solution  of  the  lower-fidelity  problem. 
This  feature  must  be  obtained  by  pre-processing  in  the  other  approaches.  The  SQP-based  AMF  also  allows 
for  an  easy  incorporation  of  commercial  software.  The  drawbacks  of  the  approach  are  not  obvious  at  this 
point. 

3.  Computational  Demonstrations.  The  computational  demonstrations  are  intended  to  validate 
the  effectiveness  of  AMF.  The  ability  to  transfer  the  computational  load  onto  the  lower-fidelity,  cheaper 
computations,  and  thereby  reduce  the  overall  computational  cost,  will  depend  on  the  predictive  qualities  of 
the  surrogates.  Note  that  even  though  the  surrogate  models  may  not  be  good  approximators  of  the  higher- 
fidelity  models  for  the  purposes  of  analysis,  they  may  possess  suitable  predictive  properties  for  the  purposes 
of  optimization.  That  is,  an  approximation  may  not  capture  all  the  important  properties  of  a  higher-fidelity 
function,  but  it  may  still  produce  a  step  that  will  lead  to  a  satisfactory  improvement  (decrease  or  increase) 
in  the  merit  function  for  the  higher-fidelity  problem. 

The  computational  tests  include  both  the  case  when  the  relationship  between  the  various  levels  of  models 
is  favorable  and  the  case  when  it  is  not.  The  relationship  is  favorable  when  the  lower-fidelity  model  can 
provide  a  long  sequence  of  steps  with  satisfactory  directions  of  descent  for  the  higher-fidelity  merit  function 
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before  the  lower-fidelity  model  has  to  be  re-calibrated.  The  relationship  is  not  favorable  when  the  lower- 
fidelity  model  does  not  satisfactorily  capture  the  trends  in  the  objective  and  constraints  computed  using  the 
higher-fidelity  model  on  a  significant  region  of  the  feasible  region. 

The  AMF  approaches  could  suffer  from  an  over-reliance  on  the  low-fidelity  models  if  the  lower-fidelity 
surrogate  does  not  predict  the  behavior  of  the  higher  fidelity  model  adequately.  In  this  case,  the  AMF  will 
be  forced  to  take  only  a  few  steps  using  the  surrogate  information  before  having  to  resort  to  re-calibrating 
the  model,  which,  in  effect,  means  optimization  with  high-fidelity  models.  Thus,  in  the  worst  case,  the  AMF 
approach  reverts  to  conventional  optimization  with  the  high-fidelity  models. 

3.1.  Computational  Experiments.  The  tests  described  in  this  paper  investigate  a  specific  type  of 
variable-fidelity  modeling — that  in  which  performing  a  single  type  of  analysis  (aerodynamic  analysis  using 
the  Euler  equations)  on  a  variety  of  related  meshes  provides  variable-fidelity  models.  In  this  case,  the  finer 
the  mesh,  the  higher  the  model  fidelity  and  computational  expense. 

It  will  be  significantly  more  difficult  to  determine  the  suitability  of  the  AMF  concept  when  the  variable- 
fidelity  models  are  represented  by  different  physical  models,  such  as  Navier-Stokes  versus  Euler,  and  par¬ 
ticularly  in  extreme  cases  of  varying  the  model  fidelity,  for  instance,  Navier-Stokes  versus  a  linear  panel 
code.  It  is  likely  that  the  framework  will  prove  infeasible  for  some  model  combinations.  The  accumulation 
of  numerical  experience  in  the  simpler  case  of  variable-resolution  models  based  on  a  single  physical  model 
will  provide  a  necessary  foundation  for  a  study  of  the  more  difficult  case  of  different  physical  models. 

The  initial  experiments  are  conducted  only  for  two  design  variables  in  order  to  visualize  the  algorithms' 
progress  easily  and  completely. 

The  problems  were  first  solved  in  a  single-fidelity  mode  by  using  well-known  commercial  optimization 
software2,  such  as  NPSOL  [19]  and  PORT  [24],  in  order  to  obtain  a  baseline  number  of  function  evaluations 
or  iterations  to  find  an  optimum.  The  problems  were  then  solved  in  a  single-fidelity  mode  with  research 
implementations  of  methods  on  which  AMF  are  based  to  obtain  a  baseline  for  comparison  with  AMF.  The 
problems  were  finally  solved  with  the  AMF. 

In  the  study  of  the  two  demonstration  problems,  a  number  of  interesting  issues  concerning  the  quality 
and  selection  of  models  arose.  Initially,  computations  were  done  on  arbitrary  meshes  of  different  sizes  with  no 
relation  between  the  meshes.  While  sufficiently  fine  meshes  should,  in  principle,  produce  consistent  functions, 
the  meshes  were  too  coarse  (even  the  finest  one)  to  observe  this  effect.  Instead,  objectives  and  constraints 
computed  on  unrelated  meshes  could  have  wildly  disparate  trends  and  features,  a  phenomenon  observed  by 
other  investigators  [12].  This  difficulty  was  remedied  by  using  coarser  meshes  that  were  proper  subsets  of 
the  finest  mesh. 

Initial  tests  were  conducted  using  the  actual  function  evaluations  obtained  by  executing  the  analysis 
software.  An  examination  of  the  problem  functions  revealed  that  they  exhibited  benign  behavior,  insofar  as 
the  objectives  and  constraints  in  the  present  study  are  smooth  and  very  nearly  convex.  However,  function 
and  gradient  evaluation  is  very  expensive  even  for  the  small  number  of  design  variables  under  consideration 
here.  Because  the  underlying  problem  was  benign  but  expensive  to  compute,  it  was  decided  to  accumulate 
generous  amounts  of  data  and  to  replace  the  actual  functions  with  a  number  of  accurate  response  surfaces.  It 
should  be  emphasized  that  the  use  of  response  surfaces  is  not  an  integral  part  of  the  approach,  and  is  not  even 
one  of  the  focuses  of  this  study.  Response  surfaces  were  introduced  strictly  to  facilitate  the  testing,  because 
they  approximate  the  trends  of  the  actual  test  functions  so  well  at  a  tiny  fraction  of  the  computational  cost. 

2 The  use  of  names  of  commercial  software  in  this  paper  is  for  accurate  reporting  and  does  not  constitute  an  official 
endorsement,  either  expressed  or  implied,  of  such  products  by  the  National  Aeronautics  and  Space  Administration  or  ICASE. 
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An  additional  benefit  of  using  response  surfaces  later  became  apparent.  In . particular,  graphics  will 
show  that  for  the  problems  under  study,  the  lower-fidelity  functions  obtained  on  coarser  meshes  provide  an 
excellent  approximation  (with  respect  to  descent  characteristics)  to  those  computed  on  finer  meshes.  This 
is  a  most  favorable  condition  for  AMF.  However,  one  must  also  investigate  cases  where  the  lower-fidelity 
problem  does  not  capture  the  high-fidelity  descent  behavior  well.  Some  of  the  response  surfaces  provide  such 
a  test  case. 

In  the  experiments,  surfaces  based  on  data  computed  by  executing  analyses  on  finer  meshes  represents 
high-fidelity  functions,  while  those  based  on  data  obtained  from  analyses  on  coarser  meshes  serve  as  low- 
fidelity  functions.  Again,  the  response  surfaces  are  used  in  the  experiments  solely  to  reduce  the  computational 
cost  to  a  point  where  testing  and  debugging  are  practical. 

Three  types  of  response  surfaces  were  used: 

1.  Two-dimensional,  uniform,  variation  diminishing  splines  (obtained  from  the  PORT  [24]  package); 

2.  Kriging  (implemented  locally); 

3.  Cubic  polynomial  response  surfaces  (coded  locally  with  assistance  from  the  RSG  [38]  package). 

For  all  three  AMF,  the  consistency  conditions  were  enforced  via  the  scaling  technique  in  Chang  et  al.  [16]. 
This  technique  was  found  to  provide  an  excellent  correction  strategy  for  the  lower-fidelity  model  in  all  cases. 

Performance  of  AMF’s  is  evaluated  in  terms  of  the  absolute  number  of  calls  to  the  high  and  low-fidelity 
function  and  sensitivity  calculations  and  the  number  of  “equivalent”  high-fidelity  computations.  The  latter 
are  easily  obtained  because  both  analysis  codes  use  multigrid  techniques,  where  this  metric  is  commonly 
computed. 

Finally,  a  conscious  effort  was  made  to  implement  the  AMF  in  a  straightforward  manner,  without  any 
“fine-tuning”,  in  order  to  obtain  a  proof  of  concept.  As  will  be  discussed  later,  significant  improvements  in 
efficiency  can  likely  be  made. 

4.  3D  Wing  Problem. 

4.1.  Optimization  Problem.  The  first  demonstration  problem  is  a  three-dimensional  aerodynamic 
wing  optimization.  The  wing  consists  of  a  single  trapezoidal  panel  with  a  rounded  tip.  It  is  parameterized 
by  fifteen  variables,  five  of  which  describe  the  planform,  five  of  which  describe  the  root  section  shape,  and 
five  of  which  describe  the  tip  section  shape.  The  wing  and  some  of  the  associated  parameters  are  depicted 
in  Figure  4.1.  Currently,  the  two  design  variables  are  the  tip  chord  and  the  tip  trailing-edge  setback.  The 
objective  function  f{x)  is  the  negative  lift-to-drag  coefficient  ratio,  —Cl/Cd.  Several  artificial  constraints 
are  imposed  in  lieu  of  multidisciplinary  constraints.  Purely  geometric  constraints  ensure  a  minimum  leading 
edge  radius  and  a  minimum  thickness.  “Aerodynamic”  constraints  are: 

1.  A  lower  bound  on  total  lift  CL  x  S ,  in  lieu  of  a  minimum  payload  requirement  ( S  is  the  semispan 
wing  planform  area); 

2.  An  upper  bound  on  Cm  (pitching  moment  coefficient),  in  lieu  of  a  trim  constraint; 

3.  An  upper  bound  on  Ci  (rolling  moment  coefficient),  in  lieu  of  a  maximum  bending  moment. 

For  the  results  we  report  here,  the  flow  is  subsonic,  with  a  free-stream  Mach  number  M oo  =  0.5.  The 
angle  of  attack  is  a  =  3°.  Given  the  subsonic  speed  of  the  flow,  the  drag  is  primarily  the  induced  drag  due 
to  lift,  Cd  oc  so  our  objective  is  effectively  -I/Cl- 

The  aerodynamic  analysis  code  used  for  this  study  is  CFL3D.ADII  [37],  a  version  of  CFL3D  [31]  obtained 
via  the  ADIFOR  automatic  differentiation  tool  [10].  The  surface  geometry  was  computed  based  on  the 
problem  parameters  via  software  that  uses  the  RAPID  technique  [35].  The  ADIFOR  generated  analysis 
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Planform  view 


Fig.  4.1.  The  3D  wing  problem 


code  includes  the  capability  for  computing  the  gradients.  The  volume  mesh  and  associated  gradients  needed 
for  CFL3D  are  generated  using  a  ADIC  [11]  generated  version  of  CSCMDO. 

Two  variable-fidelity  models  and  associated  constraints  are  generated  by  performing  the  CFL3D.ADII 
analysis  on  meshes  of  increased  refinement: 

1.  97x25x17  (low  fidelity)  and 

2.  193x49x33  (high  fidelity). 

Since  the  analysis  uses  a  multigrid  solution  process,  the  CPU  time  per  converged  function  evaluation  is 
essentially  linear  in  the  number  of  grid  points,  resulting  in  an  eight-fold  difference  in  execution  time  between 
adjacent  levels  of  fidelity.  For  example,  on  an  Ultra  1  Sun  workstation,  a  single  function  and  constraint 
evaluation  on  the  97x25x17  mesh  takes  eight  minutes,  and  the  193x49x33  mesh  analysis  takes  about  an 
hour,  without  computing  derivatives. 

4.2.  Discussion  of  Numerical  Results.  Figure  4.2  depicts  the  level  sets  of  the  objective  functions  and 
active  constraints  obtained  by  performing  analyses  on  the  193x49x33  and  97x25x17  meshes.  The  shaded 
regions  are  infeasible.  For  the  current,  subsonic  case,  the  rolling  moment  constraint  Ci  is  inactive  and  is  not 
depicted.  Solutions  are  marked  by  black  squares.  Note  that  this  problem  has  a  favorable  structure  for  AMF. 
Although  the  optima  are  at  different  locations,  the  low-fidelity  and  high-fidelity  objective  and  constraints 
have  similar  trends. 

Initial  testing  on  this  problem  was  done  with  MAESTRO-based  AMF  and  with  function  values  obtained 
directly  from  CFL3D.ADII  on  the  193x49x33  mesh  for  high-fidelity  and  97x25x17  for  low  fidelity.  For  the 
case  studied,  none  of  the  constraints  were  active.  The  analysis  count  was  as  follows.  To  obtain  a  solution 
on  the  low-fidelity  mesh  alone,  using  non-AMF  MAESTRO,  required  17  function  and  17  sensitivity  calls. 
Solution  with  the  high-fidelity  mesh  alone  was  attempted  but  not  completed,  due  to  the  expense  of  direct 
function  and  derivative  evaluations.  However,  it  is  reasonable  to  assume  that  the  solution  would  not  have 
taken  fewer  iterations  than  that  on  the  low-fidelity  mesh.  The  MAESTRO-based  AMF  required  18  low- 


fidelity  functions,  18  low-fidelity  sensitivities,  7  high-fidelity  functions,  and  7  high-fidelity  sensitivities,  for  a 
total  of  7  +  18/8  =  9  1/4  equivalent  high-fidelity  functions  and  as  many  sensitivities.  Thus  the  increase  in 
efficiency  is  approximately  twofold,  both  in  the  number  of  function  and  sensitivity  computations. 


97x25x17  mesh,  CL/CD,  CLxS,  CM 


tip  chord 


Fig.  4.2.  High-fidelity  vs.  low-fidelity  objectives  and  active  constraints:  level  sets  of  actual  functions 


It  was  at  that  time  that,  despite  a  promising  start,  it  was  decided  to  postpone  farther  studies  with 
MAESTRO-based  AMF  because  the  test  problem  structure  was  inappropriate  for  the  MAESTRO  approach, 
given  that  the  objective  and  constraint  evaluations  can  be  obtained  only  as  a  result  of  analysis,  and  there 
are  few  constraints  and  design  variables.  MAESTRO-based  AMF  will  be  tested  at  a  later  date  on  an  bona 
fide  MDO  problem. 

Computing  with  direct  analyses  was  so  laborious  and  time-consuming  that  at  that  stage  it  was  also 
decided  to  build  response  surfaces  out  of  the  accumulated  193x49x33  and  97x25x17  data  and  to  continue 
testing  using  these  substitutes  for  the  CFD  analyses. 

Figures  4.3,  4.4,  and  4.5  show  the  resulting  level  sets  of  the  response  surface  substitutes  for  the  the  objec¬ 
tive  and  active  constraints  obtained  from  the  same  CFL3D.ADII  data  used  to  generate  the  level  sets  of  the 
actual  functions  in  Figure  4.2.  While  the  objective  functions  are  approximated  well  in  all  response  surfaces, 
it  is  obvious  that  the  spline  and  kriging  approximations  do  well  with  constraints  but  a  straightforward  cubic 
polynomial  response  surface  does  not  provide  a  good  approximation  to  the  problem  constraints.  Moreover, 
the  low-fidelity  polynomial  model  is  not  a  good  approximation  to  the  high-fidelity  polynomial  model,  as 
the  Figure  4.5  demonstrates.  Thus,  the  spline  and  kriging  approximations  model  the  situation  in  which 
the  relationship  between  the  high  and  low-fidelity  approximations  is  favorable,  while  the  cubic  polynomial 
approximation  models  the  situation  when  the  relationship  is  not  as  favorable. 

The  augmented  Lagrangian-based  AMF  was  applied  to  a  response  surface  substitute  for  the  CFD  analysis 
constructed  via  kriging.  Conventional  optimization  required  37  evaluations  of  the  high-fidelity  objective  and 
constraint  values,  and  27  evaluations  of  the  high-fidelity  objective  and  constraint  sensitivities.  The  augmented 
Lagrangian  AMF  required  6  evaluations  of  the  high-fidelity  objective  and  constraint  values,  6  evaluations 
of  the  high-fidelity  objective  and  constraint  sensitivities,  51  evaluations  of  the  low-fidelity  objective  and 
constraint  values,  and  36  evaluations  of  the  low-fidelity  objective  and  constraint  sensitivities.  Since  the 
low-fidelity  analyses  take  1/8  of  the  time  of  the  high-fidelity  analyses,  the  augmented  Lagrangian  required 
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Fig.  4.3.  High-fidelity  vs.  low-fidelity  objectives  and  active  constraints:  level  sets  of  kriging  approximation 


Fig.  4.4.  High-fidelity  vs.  low-fidelity  objectives  and  active  constraints:  level  sets  of  spline  approximation 


Fig.  4.5.  High-fidelity  vs.  low-fidelity  objectives  and  active  constraints:  level  sets  of  cubic  polynomial  approximation 


the  equivalent  work  of  6  +  51/8  =  12  3/8  evaluations  of  the  high-fidelity  objective  and  constraint  values,  and 
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6  +  36/8  =  10  1/2  evaluations  of  the  high-fidelity  objective  and  constraint  sensitivities. 

The  SQP-based  approach  yielded  similar  improvements  in  performance.  Conventional  optimization, 
applied  to  a  cubic  polynomial  substitute  for  the  CFD  analysis,  required  31  high-fidelity  functions  and  31 
high-fidelity  sensitivities.  Optimization  using  the  SQP-based  AMF  required  4  high-fidelity  functions  and 
51  low-fidelity  functions,  for  a  total  of  4  +  51/8  =  10  3/8  equivalent  high-fidelity  functions  and  as  many 
sensitivities.  For  a  spline  substitute  for  the  CFD  analysis,  conventional  optimization  required  21  high-fidelity 
functions  and  as  many  sensitivities.  The  SQP-based  AMF  required  4  high-fidelity  functions,  4  high-fidelity 
sensitivities,  28  low-fidelity  analyses,  and  28  low-fidelity  sensitivities,  or  a  total  of  4+28/8  =  7  1/2  equivalent 
high-fidelity  functions  and  as  many  sensitivities. 

Both  the  augmented  Lagrangian-based  AMF  and  the  SQP-based  AMF  produced  consistent  improve¬ 
ments  in  efficiency  compared  to  non-AMF  versions  of  the  same  codes.  Improvements  in  efficiency  due  to 
each  AMF  are  summarized  in  Table  4.1.  Furthermore,  the  performance  of  the  SQP-based  AMF  can  be 
improved  by  reducing  the  amount  of  optimization  done  using  the  low-fidelity  approximation. 

Table  4.1 

Wing  optimization  problem:  Summary  of  improvement  factor  due  to  the  AMF  in  function  (first  number)  and  sensitivity 
(second  number)  computations. 


Full  CFD  analysis 

Kriging 

Spline 

Polynomial 

Augmented  Lagrangian  AMF 

3.0  /  2.6 

SQP  AMF 

2.8  /  2.8 

3.0  /  3.0 

MAESTRO  AMF 

1.9  /  1.9 

5.  2D  Airfoil  Problem. 

5.1.  Optimization  Problem.  In  this  problem,  the  objective  function  is  the  negative  lift-to-drag  co¬ 
efficient  ratio,  -Cl/Cd,  and  the  single  nonlinear  constraint  is  that  on  the  pitching  moment  coefficient  Cm- 
Figure  5.1  depicts  the  two  design  variables,  maximum  camber  and  maximum  thickness.  The  flow  is  tran¬ 
sonic,  with  Moo  =  0.8,  and  a  =  0°.  Function  and  constraint  values  are  obtained  with  the  FLOMG  code  [36] 
(applied  to  the  Euler  equations)  evaluated  on  a  129x33  mesh  and  a  257x65  mesh,  with  the  former  currently 
providing  the  lowest  level  of  fidelity.  Figure  5.2  depicts  the  level  sets  obtained  directly  from  FLOMG  on  the 
129x33  and  257x65  meshes,  respectively.  This  problem  also  has  structure  favorable  for  AMF.  While  the 
optima  are  at  different  locations,  both  the  low-fidelity  functions  exhibit  the  same  general  trends  as  do  the 
high-fidelity  functions.  Figure  5.3  shows  that  the  spline  response  surface  provides  an  excellent  approximation 
to  the  actual  functions. 

maximum 

thickness 


maximum 

camber 


Fig.  5.1.  The  2D  airfoil  problem 

The  time  per  analysis  on  the  257x65  mesh  requires  approximately  four  times  the  analysis  time  on  the 
129x33  mesh.  On  an  SGI  Octane  workstation,  the  actual  CPU  times  are  approximately  8  and  2  minutes, 
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Fig.  5.2.  High-fidelity  vs.  low-fidelity  objectives  and  active  constraints:  level  sets  of  actual  functions 


Fig.  5.3.  High-fidelity  vs.  low- fidelity  objectives  and  active  constraints:  level  sets  of  spline  approximation 


respectively,  iterating  from  free-stream  conditions. 

5.2.  Discussion  of  Numerical  Results.  Again,  the  AMF  consistently  yielded  improvements  in  effi¬ 
ciency  compared  to  non- AMF  versions  of  the  same  codes.  However,  since  the  airfoil  problem  is  a  2D  problem, 
the  gains  in  relative  efficiency  are  somewhat  smaller  (though  still  very  good)  than  those  observed  for  the 
3D  wing  problem  because  the  relative  costs  of  the  low-  and  high-fidelity  calculations  are  smaller  for  the  2D 
calculations. 

In  tests  done  directly  with  FLOMG,  MAESTRO  required  34  iterations  (each  included  an  evaluation  of 
the  objective  and  constraints  and  their  sensitivities)  on  the  high-fidelity  257x65  mesh.  The  MAESTRO- 
based  AMF  required  20  iterations  on  the  129x33  mesh  and  9  iterations  on  the  257x65  mesh.  A  reasonable 
comparison  is  made  by  considering  that  20  iterations  on  the  129x33  mesh  are  equivalent  to  5  iterations  on 
the  257x65  mesh.  Therefore,  MAESTRO  with  AMF  took  14  equivalent  iterations. 
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The  augmented  Lagrangian-based  AMF  was  applied  to  a  spline  substitute  for  the  CFD  analysis.  Con¬ 
ventional  optimization  (using  analytical  derivatives)  required  58  evaluations  of  the  high-fidelity  objective 
and  constraint  values,  and  21  evaluations  of  the  high-fidelity  objective  and  constraint  sensitivities.  The 
augmented  Lagrangian  AMF  required  6  evaluations  of  the  high-fidelity  objective  and  constraint  values,  6 
evaluations  of  the  high-fidelity  objective  and  constraint  sensitivities,  50  evaluations  of  the  low-fidelity  ob¬ 
jective  and  constraint  values,  and  30  evaluations  of  the  low-fidelity  objective  and  constraint  sensitivities. 
Since  the  low-fidelity  analyses  take  1/4  of  the  time  of  the  high-fidelity  analyses,  the  augmented  Lagrangian 
required  the  equivalent  work  of  6  -f  50/4  =  18  1/2  evaluations  of  the  high-fidelity  objective  and  constraint 
values,  and  6  +  30/4  =  13  1/2  evaluations  of  the  high-fidelity  objective  and  constraint  sensitivities.  These 
numbers  yield  approximately  threefold  improvement  in  the  number  of  equivalent  evaluations. 

The  SQP-based  approach  yielded  similar  improvements  in  performance.  Conventional  optimization, 
applied  to  the  spline  substitute  for  the  CFD  analysis  required  19  high-fidelity  function  and  sensitivity  calls, 
each.  Optimization  using  the  SQP-based  AMF  required  only  4  high-fidelity  and  19  low-fidelity  function 
and  sensitivity  calls,  each,  for  a  total  of  4  4- 19/4  =  8  3/4  equivalent  high-fidelity  analyses.  The  2D  airfoil 
optimization  results  are  summarized  in  Table  5.1. 

Table  5.1 

Airfoil  optimization  problem :  Summary  of  improvement  factor  due  to  the  AMF  in  function  (first  number)  and  sensitivity 
(second  number)  computations. 


Full  CFD  analysis 

Spline 

Augmented  Lagrangian  AMF 

3.1  /  1.6 

SQP  AMF 

2.2  /  2.2 

MAESTRO  AMF 

2.4  /  2.4 

6.  Concluding  Remarks  and  Future  Directions.  In  the  preliminary  experiments  discussed  here, 
the  Approximation  Management  Frameworks  (AMF)  yielded  about  a  threefold  improvement  in  computa¬ 
tional  cost  for  the  3D  wing  design  problem,  and  a  twofold  improvement  for  the  2D  airfoil  problem.  It  is 
believed  that  greater  improvements  can  be  achieved.  No  “fine  tuning”  of  the  AMF  approaches  has  yet  been 
done,  and  there  is  room  for  improvement  in  the  interaction  between  all  the  pieces.  In  particular,  currently 
the  inner  subproblem  of  minimizing  the  low-fidelity  model  is  probably  being  solved  to  an  unnecessarily  high 
degree  of  accuracy.  Because  the  analysis  of  the  algorithms  requires  the  subproblem  solution  to  proceed  only 
as  far  as  needed  to  ensure  sufficient  improvement  in  the  merit  function  of  the  high-fidelity  problem,  the 
subproblems  are  almost  certainly  being  over-solved.  The  efficiency  can  thus  be  significantly  improved  if  it 
is  determined  how  to  terminate  the  inner  subproblem  as  soon  as  it  produces  the  necessary  decrease.  This 
question  is  under  investigation. 

The  efficacy  of  the  AMF  depends  on  the  ability  of  the  lower-fidelity  model  to  predict  the  descent  (or 
ascent)  trends  in  the  higher-fidelity  model.  It  was  found  that  even  when  this  prediction  was  not  favorable,  as 
in  the  case  of  the  cubic  polynomial  substitute,  the  first-order  scaling  technique  due  to  Chang  et  al.  provided 
an  effective  correction  for  the  lower-fidelity  model  to  ensure  following  the  high-fidelity  trends. 

While  these  initial  experiments  are  very  promising,  much  work  remains  on  further  details  of  the  im¬ 
plementation,  as  well  as  conclusions  and  practical  guidance  for  using  AMF  for  the  selected  modeling.  The 
work  includes  study  of  the  proper  amount  of  optimization  in  the  AMF  subproblems  and  the  consequences 
for  overall  efficiency  of  the  interaction  of  the  various  levels  of  optimization  in  the  AMF.  The  relative  effi¬ 
ciency  of  AMFs  based  on  different  underlying  optimization  algorithms  will  also  be  studied.  At  this  point  the 
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SQP-based  AMF  is  the  most  promising  for  the  single  discipline  problems  and  for  problem  formulations  that 
rely  on  multidisciplinary  analysis.  A  variant  of  the  augmented  Lagrangian  approach  may  have  merit  in  the 
multidisciplinary  setting  as  well.  The  MAESTRO  approach  is  also  promising  for  multidisciplinary  problems. 
The  AMF  idea  will  also  be  applied  to  aerodynamic  optimization  with  transonic  flows;  these  problems  should 
more  fully  exercise  the  AMF  idea.  Also  to  be  examined  are  hierarchies  of  approximation  based  on  models 
other  than  variable  levels  of  discretization,  such  as  direct  response  surface  approximation  of  the  high-fidelity 
model  using  kriging.  Finally,  the  integration  of  the  AMF  idea  in  multidisciplinary  problems  will  be  studied. 
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